Joint Density for the Local times of Continuous-time Markov Chains
نویسندگان
چکیده
We investigate the local times of a continuous-time Markov chain on an arbitrary discrete state space. For fixed finite range of the Markov chain, we derive an explicit formula for the joint density of all local times on the range, at any fixed time. We use standard tools from the theory of stochastic processes and finite-dimensional complex calculus. We apply this formula in the following directions: (1) we derive large deviation upper estimates for the normalized local times beyond the exponential scale, (2) we derive the upper bound in Varadhan’s lemma for any measurable functional of the local times, and (3) we derive large deviation upper bounds for continuous-time simple random walk on large subboxes of Z tending to Z as time diverges. We finally discuss the relation of our density formula to the Ray–Knight theorem for continuous-time simple random walk on Z, which is analogous to the well-known Ray–Knight description of Brownian local times.
منابع مشابه
Joint Density for the Local times of Continuous-time Markov Chains: Extended Version
We investigate the local times of a continuous-time Markov chain on an arbitrary discrete state space. For fixed finite range of the Markov chain, we derive an explicit formula for the joint density of all local times on the range, at any fixed time. We use standard tools from the theory of stochastic processes and finite-dimensional complex calculus. We apply this formula in the following dire...
متن کاملJoint Density for the Local times of Continuous-time Markov Chains by David Brydges,1 Remco
We investigate the local times of a continuous-time Markov chain on an arbitrary discrete state space. For fixed finite range of the Markov chain, we derive an explicit formula for the joint density of all local times on the range, at any fixed time. We use standard tools from the theory of stochastic processes and finite-dimensional complex calculus. We apply this formula in the following dire...
متن کاملN ov 2 00 6 JOINT DENSITY FOR THE LOCAL TIMES OF CONTINUOUS - TIME MARKOV CHAINS
We investigate the local times of a continuous-time Markov chain on an arbitrary discrete state space. For fixed finite range of the Markov chain, we derive an explicit formula for the joint density of all local times on the range, at any fixed time. We use standard tools from the theory of stochastic processes and finite-dimensional complex calculus. We apply this formula in the following dire...
متن کاملStochastic Dynamic Programming with Markov Chains for Optimal Sustainable Control of the Forest Sector with Continuous Cover Forestry
We present a stochastic dynamic programming approach with Markov chains for optimal control of the forest sector. The forest is managed via continuous cover forestry and the complete system is sustainable. Forest industry production, logistic solutions and harvest levels are optimized based on the sequentially revealed states of the markets. Adaptive full system optimization is necessary for co...
متن کاملLecture 3: Continuous times Markov Chains. Poisson Process. Birth and Death Process. 1 Continuous Time Markov Chains
In this lecture we will discuss Markov Chains in continuous time. Continuous time Markov Chains are used to represent population growth, epidemics, queueing models, reliability of mechanical systems, etc. In Continuous time Markov Process, the time is perturbed by exponentially distributed holding times in each state while the succession of states visited still follows a discrete time Markov ch...
متن کامل